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We  present  a  preliminary  simulation  study  on  the  observability  of  fermentation  processes  using  simple  sensors  -  a 
pH  meter,  a  dissolved  oxygen  (DO)  meter,  a  thermometer  and  a  C02  meter.  Our  results  show  that,  at  least  for  the  penicillin 
fermentation  process,  those  measurements  alone  cannot  give  the  state  observability. 
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Fermentation  processes  can  be  modeled  with  a  set  of  coupled  differential  equations  that  describe  the  progress  of 
the  activity  or  state  in  a  bioreactor  such  as  the  growth  of  microbes,  consumption  of  nutrients  and  the  generation  of  products 
[4],  [5].  These  state  equations  may  be  the  ones  either  inspired  from  the  kinetic  models  of  biological  interaction  or  based  on 
black-box  regression-type  parametric  models.  In  either  case,  various  parameters  present  in  the  state  equations  are  highly 
dependent  on  the  strains  or  bioreactors  used  in  a  particular  fermentation  process,  and  therefore  need  to  be  identified 
experimentally.  Once  those  parameters  in  the  state  equation  are  identified,  we  can  use  the  model  to  control  the  input 
variables  such  as  the  feed  rate  of  nutrients,  temperature  or  pH  to  maximize  the  product  generation  [6],  [7],  [8]. 

However,  such  an  optimal  control  of  input  variables  requires  the  knowledge  of  the  state  variables  x  in  real-time. 
Some  state  variables  such  as  pH  may  be  directly  measurable,  while  others  such  as  intracellular  enzyme  concentration 
cannot  be  measured  at  all  in  real  time.  Still,  another  possibility  is  to  measure  some  other  variables  z  such  as  optical 
density,  instead  of  the  state  variables  themselves.  In  this  case  however  we  need  a  knowledge  of  the  nonlinear  observation 

z  =  h(x) 

equation  v  '  .  Although  optimal  control  techniques  of  the  fermentation  process  have  been  studied  for  several  decades, 
the  lack  of  adequate  real-time  sensors  and/or  accurate  observation  equations  prohibit  biotechnology  industry  from  adopting 
this  mathematical  technique. 

In  this  regard,  an  important  question  is  whether  widely  available  sensors  such  as  a  pH  meter,  dissolved  oxygen 
(DO)  meter,  thermometer  and  C02 meter  may  be  usable  to  observe  the  state  variables  [1],  [2],  [10].  This  observability  issue 
is,  of  course  process  dependent,  and  there  is  no  general  comprehensive  theory  developed  so  far  to  check  if  a  given 
nonlinear  state  equations  and  observation  equation  are  observable  or  not.  The  purpose  of  this  paper  is  to  address  this 
question  through  a  simulation  study  in  the  case  of  penicillin  fermentation  process  [3],  [7],  whose  state  equations  have  been 
developed  by  Birol,  Uendey  and  Cinar  [3].  Namely,  we  use  an  extended  Kalman  filter  (EKF)  [2],  [9]  to  estimate  the  state 
vector,  with  the  pH,  DO,  temperature  (T),  and  CO2  measurements,  and  check  if  there  is  a  diverging  element  in  the  state 
error  covariance  matrix.  If  any  element  in  the  state  error  covariance  matrix  becomes  infinity,  then  it  indicates  that  the 
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corresponding  subspace  of  the  state  vector  space  is  unobservable  with  the  given  measurement  set. 

Although  our  approach  is  not  general  nor  analytic,  we  hope  that  we  could  gradually  gain  some  insight  on  the 
general  observability  condition  through  such  particular  simulation  studies. 

STATE  EQUATIONS 

The  majority  of  known  fermentation  process  models  do  not  take  pH,  DO,  T  and  CO2  as  state  variables,  perhaps 
because  their  dependencies  with  standard  state  variables  such  as  product  or  substrate  concentrations  are  generally  unknown 
or  inaccurate.  In  this  paper,  we  assume  that  the  model  in  [3]  is  indeed  accurate,  and  that  an  accurate  model  can  always  be 
found  through  a  proper  system  identification  methodology.  For  simplicity,  we  shall  consider  the  batch,  rather  than  the 
fed-batch,  fermentation  process  of  penicillin  production.  As  has  been  done  in  [3],  let  us  define  the  followings  as  the  state 
variables: 

X  =  X 

1  ,  biomass  concentration  in  [g/L], 
X  -  H  + 

2  ,  hydrogen  ion  concentration  in  [mole/L] 
X  =  P 

3  ,  penicillin  concentration  in  [g/L] 
X  =  S 

4  ,  substrate  concentration  in  [g/L] 

x  =  C 

5  L ,  dissolved  oxygen  concentration  in  [mmole/L] 


,  generated  heat  in  [cal] 


X  =T 

1        ,  temperature  in  Kelvin 

x  =  CO 

8  2  ,  carbon  dioxide  concentration  in  [mmole/L] 

It  will  be  convenient  to  organize  the  above  state  variables  as  a  state  vector 

X     [Xj ,  X, ,  X^ ,  X^ ,  X^ ,  Xfi ,  Xj ,  Xg  ] 

Then  it  is  known  [3]  that  the  following  set  of  coupled  first-degree  differential  equations  can  describe  the  progress 
of  the  fermentation  process: 


dx. 


1  +  ^  +  ^ 


•  kG  exp 


Rx7 


-  kD  exp 


Rx7 


dx2 
dt 
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p 

dt     ^PP  1        3  kp  +  x4  +  x4  /  kj  k0Pxx  +  x% 


dx4  _ 

dt 

yXis 

yPis 

dx5 

- "  *, 

Upp 

dt 

yXio 

yP\0 

dx, 

—  =  rQlM-vx,  +  rQ2vxl 


dxn  1 
—  xb 


dt  vpCP 

dt 

where  the  initial  state  vector  is  assumed  to  be  as  in  [3]: 

x0  =  [0. 1, 1(T5 1 , 0, 15, 1 . 16, 0,  297, 0.5f 

and  the  parameter  values  are  as  follows: 

R  =  1.9872041  [cal/K  •  mole]  *5,o  =  L16  [mmole/L]  jux  =  0.092  [h1]  k,  =  10~10  [mole/L] 

5  5  5 

jfc2=7xlO"5[mole/L]  kx=0A5  kox=2xl0~2    fcG=7xl03  kD=!033 

5  5  5  5  i 

EG  =5100[cal/mole]  ED  =  50000  [cal/mole]  ^=10"5  //P  =  0.005  th1]  ^  =  0.04[h  '] 

5  5  5  5 

fcP  =  0.0002 [g/L]  fc,=0.1[g/L]  fcop=5xl0~4  p  =  3        =  0.45  Y„s  =0.9 

mz  =0.467  [h1]  yxlo=0.04  yp|o=0.2  m0  =0.467  [h ']  pCP  =  1500  [cal/LC] 

ax  =0.143  [mmole/g]  a2=4xl0~7  [mmole/h]  a3=10"4  [mmole/Lh]  &M=40 

v  =  100  [L] 
STATE  ESTIMATION 

The  first  step  of  estimating  the  state  variables  using  the  EKF  is  to  digitize  the  above  differential  state  equations  to 

get: 
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If  we  use  the  simple  Euler  method,  we  shall  have 
xi,k+i  =  xi,k  +  Mxi,k 

X2,k+l  ~  X2,k  TMXl,k 

X3,k+\  ~  X3,k      MppXl,k  ~kX3,k 


M    „  Mf 


Xa    /.^l  X*   I-  X\  y  X\  h  fitly  X 


v4,*+l  ~  A4,* 


l,k  '"■xAl,k 


'X\S 


VP\S 


f£  f^pp  J       /  \ 

X5,k+1  ~  X5,k  Xl,k  X\,k  ~m0X\,k  +  ^LA\X5fi  ~  X5,k  ) 


"x\o 


X6,k+1      X6,k  +  rQlMVXl,k  rQ2VXl,k 


+  1 

X7,k+1  ~  X7,k  ~  X6,k 

vPcp 


XS,k+l  ~  XS,k  +  aiMXl,k  +  ®2X\,k  +  ^3 


The  next  step  is  to  get  the  Jacobian  matrix, 


F  □ 


3f 

3x 


to  propagate  the  state  error  covariance.  The  computation  of 


F  requires  the  partial  derivatives  of  ^  and  ^pp .  Therefore,  first  let  us  consider  ^  : 

Jil  —  A^  "  A^  '  A^  '  A^  A^ 

where 


Mx 


A-  , 

%2  ^2 


' 1        A,  =  —         A4  =  kc  exp 


4  =  kD  exp 


//,n^,  i  =  i,2,-,8 

ox 

It  is  easy  to  check  that  '  are  given  as  follows: 


Mi  ~  AAA 


-Mi 


Mi  -  A       3  ,2  kxAA  +  AA        5  ,2  ^0x^4 

{kxx1+  x^)  k^ox  xi    ^-5  / 


^  I   ^1    1  -^2 

"^2  ^"2 


—  i^1^3J^4  2 

^3=0  (kxxl+x3) 


kxxl  /l5  —  \\AL 


(koxxl  +  x5) 


Impact  Factor  (JCC):  2.9866 
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^6=0 


E  E 

//7  =  Al  A2  A3A4  ■  — —  -  A5  ■ 


Rx*        Rx2n  jus=0 


djUp 


Similarly,  the  partial  derivatives 


dx 


'  of 


^  -  *4  ^  *5  

ftpp     /^p  *      "  kp  ~h  X^  H~  X^  I  kj  fa,QpX^  ~\~  x^ 

1 

are  given  by 


Mpp,i    Mp ' 


-x' 


{k0pXl+XP5f     °P    jUpP,2=0  //pp3=° 


_     4  (^  +  x4+x42/fe7)-x4(l  +  2x4/^)  _  pxr'C^+xQ-x^xr1 


+  x4  +  x4  /  fc7 ) 

/J-pp  6  —  0    fJ-pp  -j  —  0    /^>p,8  —  0 

F(x)  = 


Q^OPX\      ^5  ) 


3x 

v    j  y 


a,,) 


Then  elements  of  the  Jacobian  matrix  v     J  '  are  given  as 

fu  =l  +  /IlX1+/J,     fu2=MlXl     /l,3=0     flA=^Xl     fl,5=PsXl    fl,6=0     flJ=PlXl  /l,8=0 

5  5  5  5  5  5  5 

f2,i  =  r(Mixi+M)  f2,2  =  1+rM2xi  /2,3  =  Wi=o  fzA  =  r^xx  /y=w 

=PpplX\  +  Ppp     fl,2=Llpp2X\=^     f3,3  =^+MPp3Xl~^  =l~k     f3A=Mpp4Xl  f3,5=Ppp5Xl 

5  5  5  5  5 

/3,6=/V-*l=0     hl=VpplXl=0  f3,$=Mpp&Xl=0 


P 


/_    *  ppl        \     ?™        *  ppl  *  pp  -C      _       r"2  '   

4,1  —  ■*!  ~l  -^1  J  4,2  —  -^1  ^1  —  _ 


^2    v       ^/>i>2  //2 


^xis     yxis  ypis  y~pis 


yxis     ypis  yxis 


J4,3  —  Al  Aj— V     744—  1  Aj  Aj     745  —  Aj  ^.j 


yxis  y^s 


yxis  ypis 


yxis  ypis 


J 4,6  —  X\ 


Xj  —  0    f41  —  Xj  Xj  —  Xj       8  —  Xj  Xj  —  0 

yxis     yp\s  yxis     ym       yxis  yxis  y^s 
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A.  =- 


Xj  m0   /5  2  —         xl  Xj  —  — 


J  5,3  Xl 

yx\o  yp\o 


x,=0  /5>4  =-^.v,  -^v,=0  /5j5  =l-^x,  -^.v,  +k 


yx\o  yp\o 


MPP5 

Xj  ^vj    i  .vM 


f  _    A,  n  f  __Jh_v  _tfpp]_r  -_Jh_T   f  -_Jh_r  _^£Pir  -n 

i5,6  Al  Al      u     i5,7  Al  Al  Al    i5,8  Al  Al  u 

^xio     y^io  yx\o     yp\o      yxio  yx\o  yp\o 

/6,1  =  ^1  Wl  +r?lV>"  +  rglV  t  fe,2  =  rglV^2Xl  t  /6,3  =  ^1  Wl  =  0  t  /6,4  =  r9l  Wl  ^  /6,5  =  V  > 
/6,6  =  1  +  V  Wl  =  1    /6,7  =  /6,8  =  r9l  Wl  =  0 


f7l=0  f12=Q  /7>3=0  /7>4=0  /7,5=0  ^b    v/?CT   /7,7=1  /7,8=0 

J  J  J  J  J  J  J 

fSA  =  alju1xl  +  alju  +  a2  fS2=aljulx1  fs^=aji3xl=0  f%A  =  ax^xx  /85=or1//5x1 
/b,6  —  &iMbxi  ~  0  /sj  —  cc1fj.1xl  /88  —  l  +  ccl/j,sxl  —  1 

If  we  assume  the  state  variables    2'   5'   7'   8,  i.e.,  ^  ,     L  ,  *  ,       2  axe,  measured,  then  the  observation 
matrix  will  be  ^1  below,  On  the  other  hand,  if  Xl '  Xl '  Xs '  Xl '  ^8  are  measured,  then  the  observation  matrix  becomes 


H, 


0  1  0  0  0  0  0  0 

0  0  0  0  1  0  0  0 

0  0  0  0  0  0  1  0 

0  0  0  0  0  0  0  1 


Hn  = 


1  0  0  0  0  0  0  0 

0  1  0  0  0  0  0  0 

0  0  0  0  1  0  0  0 

0  0  0  0  0  0  1  0 

0  0  0  0  0  0  0  1 


Finally  the  EKF  using  the  continuous  state  equation  and  the  discrete  observation  equation  can  be  descried  as 


follows: 


fork=0,l, 


Re,k=R  +  HPUklHT 


Gk  ~  Zk  H*k\k-1 


*k\k       *k\k-l  ^  rk\k-\n  ^e,k*k 


Impact  Factor  (JCC):  2.9866 


Index  Copernicus  Value  (ICV):  3.0 
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P    —  P      —  P      fJT  R 1  '  MP 

rk\k       rk\k-l      rk\k-\n        (■  .knrk\k-l 


j    -f(x(0)      x(t  )Ux  x(t  )  □  x 

Solve     "?  for    v  *+M  starting  with    v  k>  m 

p     =  F   P  FT  +0 

1  k+Uk  k+1    k\k    fc+1  ^ 


end 

SIMULATION  RESULTS 


x, 


1  and        2  ooainct  tti£»  triif» 


Figure  1  compares  the  state  estimates  obtained  with  "1  and  " 1  against  the  true  "*'v ,J  obtained  by  solving 
the  differential  equation.  We  can  see  that  the  results  with  1  do  not  estimate  the  true  state  vector  correctly,  except  the 
ones  that  are  directly  measured,  whereas  the  addition  of  bio  mass  measurement  in  2  gives  accurate  state  vector  estimates. 
CONCLUSIONS 

In  this  paper,  we  have  studied  the  observability  issue  in  the  process  modeling  through  a  simulation  study  of  the 
penicillin  fermentation  process.  It  has  been  found  that  the  widely  available  sensors;  pH  meter,  dissolved  oxygen  (DO) 
meter,  thermometer  and  C02  meter  are  not  adequate  to  make  the  process  observable. 
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Figure  1:  Comparison  of  State  Estimates  for  Different  Sets  of  Measurements 
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